Skip to main content

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: Robin_1990 Date: May 7, 2008 8:25am
Forum: web Subject: Robots.txt Policy makes little baby Gohan cry!

It's true.

Reply to this post
Reply [edit]

Poster: MSRX92 Date: May 7, 2008 1:20pm
Forum: web Subject: Re: Robots.txt Policy makes little baby Gohan cry!

Surely there is a different way to do this. Like, if I take a picture of someone's house, and the house is sold, the new owner can't demand that I no longer show anyone a picture of that house.

Reply to this post
Reply [edit]

Poster: DannyDaemonic Date: May 8, 2008 12:38am
Forum: web Subject: Re: Robots.txt Policy makes little baby Gohan cry!

This is the best idea I can come up with, and it's certainly better than what we currently have. And some might argue it's completely fair. I'm not one of those people but I could see this making a certain group of people 100% happy. Perhaps even the lawyers would ok this one.

The major problem my solution solves is people putting up robots.txt's that deny all robots in an attempt to save on bandwidth while they decide what to do with their website, or squat on it, or resell it, or whatever. The accidental side effect is they delete their archive history for the whole site.

Knowing this has been stopped should comfort you, a least a little since there are no more accidental erasures (and most people don't even know about the internet archive). Of course you are always free to archive your own website on CD or DVD or whatever medium you choose. That will have to be your picture for now.